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the encoder buffer receives a previous picture, and allocating a number of bits to the current picture based on the buffer fullness, such that 
the allocated bits of the current picture is within the bit budget. 
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VIDEO RATE-BUFFER MANAGEMENT SCHEME FOR MPEG 

TRANSCODER 

CROSS-REFERENCES TO RELATED APPLICATIONS 
This application claims priority from Provisional U.S. Patent Application 
5 No. 60/1 18,965, filed February 4, 1999, the disclosure of which is incorporated herein in 
its entirety by reference for all purposes. 

BACKGROUND OF THE INVENTION 
The present invention relates generally to the encoding and decoding of 

1 0 multimedia data, and more particularly the invention relates to rate-buffer management in 
a transcoder of encoded, precompressed video data. 

A transcoder is a device that receives a bitstream that is pre-compressed and 
pre-encoded according to one of many digital transmission techniques, and outputs a 
compressed bitstream of a different transmission bit-rate. A simplified block diagram of a 

15 transcoder system 1 0 including a transcoder 12 is shown in Fig. 1 . The transcoder 12 

accepts a precompressed, encoded signal of video frames on an input from a transmission 
channel. The transmission channel may be a satellite transmission network, or cable 
transmission medium, for example. The input signal is decoded by a decoder 12 and re- 
encoded by an encoder 14, whereupon the re-encoded signal is output at a different, 

20 usually constant, bit-rate. Using well-known techniques of adjusting a quantization level 
of the re-encoded signal, careful management of encoder parameters can provide a high 
quality signal at a desired bit-rate that is tailored for a specific output transmission 
channel or application. 

An MPEG-2 video transcoder is a specific example of a transcoder that 

25 may employ techniques of the present invention. MPEG-2 is a conventionally accepted 
standard for digitally coding moving pictures, such as a video signal, for compressed 
transmission. The MPEG-2 video transcoder converts a pre-encoded and compressed 
video bitstream according to MPEG-2 video compression standards into another MPEG-2 
encoded, compressed video signal for transmission at a different bit-rate. 

30 An MPEG bitstream has six layers of syntax, at which certain coding 

parameters are specified. There are a sequence layer (random access unit, context), 
Group of Pictures (GOP) layer (random access unit, video coding), picture layer (primary 
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coding layer), slice layer (resynchronization unit), macroblock layer (motion 
compensation unit), and block layer (DCT unit). 

The term "signal" is applied herein to mean any picture, frame, or block. 
A block is an 8-row by 8-column matrix of pixels. A macroblock (MB) is four 8x8 

5 blocks of luminance data and 2, 4 or 8 corresponding 8x8 blocks of chrominance data 
derived from a 16x16 section of the luminance component of the picture. A slice refers to 
a series of macroblocks. Blocks of source data may be encoded by frame, macroblock, 
or slice. The first bit-rate may be for high-capacity satellite transmission of a coded 
source video, and the second bit-rate may be downscaled for lower-capacity local cable 

10 transmission, ultimately to a set-top box decoder to an individual viewer. A Group of 
Pictures (GOP) is a set of frames which starts with an I-frame and includes a certain 
number of P and B frames. The number of frames in a GOP may be fixed. Data rate for 
a given bitstream is directly related to buffer size and the speed with which bits are placed 
into and emptied from the buffer. 

15 Every transcoder employs some type of video rate-buffer management 

technique for preventing buffer under- and/or over-flows. In a decoder buffer under-flow 
situation, the decoder buffer is being emptied faster that it is being filled. Consequently, 
too may bits are being generated in the encoder, which will eventually overflow. To 
prevent decoder underflow, video rate-buffer management may provide for an increased 

20 quantization level, adjust the bit allocation, discard high frequency DCT coefficients, or 
repeat pictures. 

In a decoder buffer over-flow situation, the decoder buffer is being filled 
faster than it is being emptied. In other words, too many bits are being transmitted and 
too few bits are being removed by the decoder such that the buffer is full. Consequently, 

25 too few bits are being generated in the encoder, which will eventually underflow. Some 
video rate-buffer management techniques employed to avoid this situation include 
decreasing the quantization level, adjusting the bit allocation, and stuffing bits. 

Quantization level and bit allocation adjustments are conventionally 
accomplished by rate control algorithm along with an adaptive quantizer. A transcoder 

30 system 20 is illustrated in Fig. 2 with rate control 25 and adaptive quantization 23 

mechanisms. Generally, an encoded, compressed signal is first stored in a decoder buffer 
-22, and then decoded at a decoder 24 in blocks or group of blocks. Rate control 25 is 
applied to control a data rate of bits being removed from the decoder buffer 22, based on 
a number and rate of bits being added to an encoder buffer 28. Adaptive quantization 

2 
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adjusts a quantization level of a bitstream as it is re-encoded by the encoder 26. Rate 
control and adaptive quantization are generally accomplished in three steps: 

1 . Bit Allocation 

Most encoders have an optimized, and often complicated, bit-allocation 
5 algorithm to assign the number of bits for each type of pictures (I-, P- ? and B-pictures). 
Conventional bit-allocation techniques take into account the prior knowledge of video 
characters (e.g. scene changes, fade, etc.) and coding types (e.g. picture types) for a group 
of pictures (GOP) by estimating a complexity and allocating target bits for a given GOP. 
Complexity Estimation: each picture type of I, P, and B pictures is 
10 assigned a relative weight X according to a global complexity measure of a Complexity 
Estimation technique. These weights (Xi, Xp, Xb) are reflected in a typical coded frame 
size of I, P, and B pictures. I pictures are assigned the largest weight since they have the 
greatest stability factor in an image sequence. B pictures are assigned the smallest weight 
since B data does not propagate into other frames through the prediction process. 
15 Picture Target Setting: allocates target bits for a frame based on the frame 

type (I, P, and B) and the remaining number of frames of that same type in the GOP. 

2. Rate Control 

Rate control attempts to adjust bit allocation if there is significant 
difference between the target bits (anticipated bits) and actual encoded bits for a block of 
20 data. 

3. Adaptive Quantization 

Adaptive quantization is applied in the encoder along with rate-control to 
ensure the required video quality and to satisfy the buffer regulation. Adaptive 
quantization usually recomputes the macroblock quantization factor according to a 

25 comparison of the activity of a block against the normalized activity of the frame. The 

effect of this is to roughly assign a constant number of bits per macroblock, which results 
in a more perceptually uniform picture quality. 

As video distribution networks grow larger and more complex, transcoders 
using rate-control and adaptive quantization are required to be lower-cost, simple, and yet 

30 retain a good video quality. A video rate-buffer management scheme that includes a 

simplified rate-control and adaptive quantization algorithm is therefore highly desirable. 
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SUMMARY OF THE INVENTION 
The present invention provides a simplified rate control algorithm for a 
conventional video transcoder without requiring the GOP information. This may be 
accomplished by maintaining picture types, re-using motion vectors, and minimizing 
5 changes to the macroblock mode, and achieve the required video quality. 

According to one embodiment, the present invention provides a method of 
managing a video transmission bit-rate in a transcoder. The method includes the steps of 
measuring a fullness of an input buffer of the transcoder, providing a bit budget for one of 
plurality of frames in an input bitstream, the bit budget being based on a quantization 
10 parameter of said video frames, measuring an actual bit-rate of said input video stream, 
and comparing said actual bit-rate with said buffer fullness to predict an input buffer 
underflow or overflow. In response to an input buffer underflow, the bit budget is 
incremented for a next one of said plurality of video frames. In response to an input 
buffer overflow, the bit budget is decremented for next one of said plurality of video 
15 frames. 

According to another embodiment, the present invention provides a 
method of controlling a bit-rate of a plurality of pictures in a video transcoder, where the 
transcoder includes a decoder and an encoder. The method includes the steps of 
determining a bit budget for a current picture at an input to the decoder, measuring a 

20 buffer fullness of an encoder buffer when the encoder buffer receives a previous picture, 
and allocating a number of bits to the current picture based on the buffer fullness, such 
that the allocated bits of the current picture is within the bit budget. 

Other features and advantages of the present invention will be understood 
upon reading and understanding the detailed description of the preferred embodiments 

25 below, in conjunction with reference to the drawings, in which like numerals represent 
like elements. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 schematically illustrates a conventional video transcoder system. 
30 Fig. 2 schematically illustrates a conventional video transcoder system 

with adaptive quantizer and rate-control mechanisms. 

Fig. 3 schematically illustrates a video transcoder system including a video 
rate-management controller according to an embodiment of the present invention. 
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Fig. 4 illustrates a processor block of the video rate-management scheme 
according to an embodiment of the present invention. 

Fig. 5 illustrates a processor block of the video rat-management scheme 
according to an alternative embodiment of the present invention. 

5 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
The present invention provides a rate control process for efficient video 
rate-buffer management. According to a preferred exemplary embodiment of the 
invention, the rate control process is implemented in a video transcoder to control a 

10 transcoder output bitstream which complies with the requirements of the Video Buffering 
Verifier that are specified in the MPEG-2 video standard (ISO/IEC 13818-2). 

Fig. 3 illustrates a video transcoder 30 with a video rate-management 
system 32 according to an embodiment of the present invention. The video rate- 
management system operates according to a rate management process. The rate 

15 management system 32 includes a controller 34 operatively coupled to the transcoder, and 
providing instructions to a Video Buffering Verifier (VBV) 36. 

A Video Buffering Verifier (VBV) is a virtual decoder that is conceptually 
connected to the output of the encoder. Its purpose is to provide a constraint on the 
variability of the data rate that an encoder or editing process may produce (IS013818-2 

20 Annex C). The VBV contemplates a buffer in the receiver at the receiving end of the 
output transmission channel (not shown), and a prediction mechanism in the encoder. 
The prediction mechanism may a processor and control circuit that predicts a fullness of 
the buffer, i.e. buffer fullness, due to the constant fill from the constant bit-rate (CBR) 
stream and the variable empty from the variable bit-rate (VBR) due to the decoder bit 

25 demand. 

In an embodiment of the present invention, the controller 34 prevents 
encoder VBV 36 buffer under- and/or over- flows. The encoder VBV buffer may be a 
shifted "mirror" of a decoder VBV buffer, however for simplification only the encoder 
VBV will be discussed in detail. For Constant Bit-rate (CBR) applications, by a use of 
30 rate-control, a bit-count-per-second must precisely converge to the target bit-rate with 
good video quality. For Variable Bit-rate (VBR) applications, the rate-control achieves 
the goal of maximizing the perceived quality of decoded video sequence with the 
maintained output-bit-rate within permitted bounds. By employing a rate-management 
system of the present invention with rate control, transcoder buffer under- and over-flows 
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are avoided without adding too much complexity to the overall operation of the 
transcoder system. 

In accordance with the invention, for a number of pictures 1 -j, the VBV 
buffer is characterized by the following parameters: 
5 vbvjbuffer JullnessQ): the encoder VBV buffer bit-level right before 
encoding of the j-th picture. 

coded jpictjsize(j)\ the bit-count of the j-th coded picture. 
bits incrementQ+l) : the number of bits transmitted between the j-th and 
(j+l)-th coded pictures. 
10 vbvj)uffer_size: the (decoder) VBV buffer size coded in the sequence 

header and sequence extension if present. 

These parameters satisfy the recursive equation: 

vbv_buffer_fullness(j+l) = vbv_buffer_fullness(j) + 
coded_pict_size(j) - bits__increment(j+ 1 ). (la) 
1 5 Assume the encoding time of j-th picture is t e j and decoding time of j-th 

picture is tdj. Then an upper bound on the VBV fullness is: 

vbvbuffer_fullness(j) + coded_pict_size(j) < J R(t)dt 

t . 

(lb) 

The VBV fullness upper bound is illustrated in Fig. 4, and 

20 \R{t)dt < vbv_buffer_fullness(j) + vbv_buffer_size, 

t . 

(1c) 

Where R(t) is the bit-rate function. The left-side of Eq. (1c) is set to a maximum value as 

Tmax = (tdJ " tej) Rmax* 

25 (Id) 

Where t d j - t e j is the delay of the channel and R max *is the maximum channel bit-rate 
between t d j- t e j- 

Therefore, a VBV fullness lower bound is: 
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vbv_buffer_fullness(j) > -vbv_buffer_size + Tmax* 

(le) 

The VBV fullness lower bound is illustrated in Fig. 5 
A video rate-buffer management process according to the invention can be 
5 accomplished with rate-control and adaptive quantization for efficient buffer-control. 

The rate-buffer management system and method according to an 
embodiment of the present invention checks a bitstream to verify that the amount of rate- 
buffer memory required in the decoder is bounded by the vbv_buffer_size. The rate- 
control process will be guided by the rate-buffer management protocol to ensure the 
10 bitstream satisfying the buffer regulation with good video quality. 

In one step of the rate-buffer management and rate-control process, a bit- 
budget is determined for each picture. In one embodiment of the invention, for the 
MPEG-2 transcoder for example, a bit-allocation process is followed for determining the 
bit-budget for each picture. According to the process, and for convenience of discussion, 
15 the following terms define the encoder VBV buffer-related variables: 

target_bit_rate: the VBR or CBR bit rate from a storage media to the 

decoder; 

target _pict_size: the targeted bit-count of the current picture, often call the 
bit-budget for the picture. 
20 input Jbit_r ate: the bit rate of the input bitstream, 

input _pict_size: the bit-count of the current input (coded) picture (without 
picture header bits); 

coded j?ict_size\ the actual bit-count of the current coded picture (without 
picture header bits). 

25 framerate: the frame rate of the video sequence given in the sequence 

header. 

max_ybv_buffer _fullness(j): assigned for the j-th picture or the j-th GOP. 

According to the invention, the bit-budget for the j-th picture is allocated 
by a down-scaling transformation as follows: 
30 target _pici_size(j) = input _pict _size(j)* '(target _bit_r ate/input Jbitr -ate). 

In an alternative embodiment, bit-allocation for the j-th picture 
accumulates the bit-budgets of all macroblocks (MBs): 
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target _pictjsize(j) 

munber of _MBs—\ 

= ^ round {input _mb _ size(i) * ta/^er _ bit _ rate I input _ bit _ rare + 0.5) 

1=0 

where the round(*) function performs a rounding-toward zero and 
input mbjsize(i) denotes the bit-count of the i-th input MB. It should be understood that 
5 input jnb_size(l)*targetjbit_rate/input_bit_rate is the target MB size. The bit-budget 
target jpict_sizeQ) for the j-th picture is checked against the vbvjbuffer JullnessQ) to 
prevent the VBV buffer under- and over-flows. The condition on the VBV buffer under- 
flow provides an upper limit on the bit-budget. The reason is that, at the time of 
decoding, the current picture should be small enough so that it is contained entirely inside 
10 the decoder buffer. 

It is known for transcoder that target _pict_size(j) needs to satisfy 
target _pictjsize(j) < input _pict__size(j). 

If the current picture size is too small, then Eq. (la) might exceed the 
max_ybv_buffer JullnessQ+1) and then cause decoder buffer overflow. Thus a lower 
15 limit is placed on the current picture size. This may be achieved, for example, by limiting 
the bit budget, and if the actual bits used is still smaller than the minimum picture size, 
then the end of the picture may be stuffed with zero's. The lower limit is derived from 
Eqs.(la) and (le) as follows. 

target _pictjsize(j) > vbv_buffer_size + T max - vbv_buffer_fullness(j-l) + T mi „ . 
20 where T m i n =(tej - t ej -i) R min and R min . is the maximum channel bit-rate between t ej - t e j-i - 
Note that R min = Rmax for the CBR channel. 

The inequality condition of (le) is verified for each slice or frame to 
prevent the encoder buffer under-flow. 

Down-scaling bit-allocation takes advantage of information provided by 
25 the input bitstream for CBR applications. For VBR applications, the down-scaling 

process requires an instantaneous bit-rate for each picture or every few pictures. This bit- 
rate, associated with maxjvbvjbuffer Jiillness, can be provided from StatMux. 

It is shown in the next section that the target picture size or the target MB 
size will effect the virtual buffer fullness and, as a consequence, it will generate the 
30 quantization scale for the corresponding MB. 

In general, the quantization scale (denoted by mquant) for the transcoded 
bitstream can also generated through a scaling process. Some commonly-used bit- 
allocation models are: 

8 
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(1) T = -^ in MPEG-2 Test Model 5(TM5) [3]. 

k k 

(2) T = + in MPEG-4 verification model [4]. 

Where Tis the bit-budget for a picture or a slice or a MB, and k 0 , k { are 
constants that are generated by a pre-estimation[4], and Q denotes the quantization scale 
corresponding to a picture or a slice or a MB, respectively. Since 
T t arg et I T in P ut = target _ bit _ rate I input _ bit _ rate , the quantization scale for the 
transcoded MBs thus can be estimated by: 

For the model T = — ,Q =Q - in P ut - hit - rate 

— + , the quantization scale Q can be computed by 



k 0 +^ 0 2 +4-5.*, 



10 solving a quadratic equation : Q tzx%et - — — v ^ — where 

5 = 



,arg« 2 R 

r \ 

target _ bit _ rate 



input _ 6zf _ rare 



^ ^ input \£ i n p Ut J 

Where Q input can be the average quantization level for this picture or slice 

at the input, or the quantization level of the MB at the input. The same process can also 
be applied to other bit-allocation models. 
15 Adjustment to the quantization scale may be accomplished according to 

the embodiment illustrated below. Let Q v denote the quantization scale determined by 
the virtual buffers fullness and Q target be the up-scaled quantization level given above. 

Assume that £? /arge , is the up-scaled quantization level for a given MB. 
Then, the quantization scale Q T for the MB is determined by 

c urren t current 

20 If( ^ coded_mb_size> ^ target_mb_size) 

0 0 

Q T =max(& argc ,,a); 

else 

G r =min(fi laiB . f ,G y ). 
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In an alternative embodiment, the quantization scale may be adjusted as 
follows. Assume that Q tZT%et is the up-scaled quantization level for a given picture or 

slice at the input and Q input is the average quantization level for this picture or slice at the 

input, respectively. Then, 

1 Qtzv%etMB ~~ QinputMB (Qinput ~~ Qtaxget ) * 

The quantization level Q T for the MB is determined by 



current L. urrcn i 

If( ^ coded_mb_size> ^ target__mb_size) 

0 0 

Q T =max(a arge/Affl ,2 v ), 



else 

10 Q T =min(Q t ^ etMB9 Q v ) 



The down-scaling process for bit-allocation is applied to the macroblock 
levels for their bit-budget estimation, and is described below with rate-buffer 
management and rate-control. According to an embodiment of the present invention, a 
15 rate management process includes five steps. In this embodiment, the down-scaling 
process for bit-allocation is only applied to the macroblock levels, which simplifies the 
bit- parser and counting process. For CBR applications, such a down-scaling process 
ensures that the VB V buffer never overflows for a "legal" input bitstream. 



20 1 . Initial conditions in Sequence Level 

The vbv buffer is initially filled the vbvjbuffer Jullness amount of bits. For 
CBR applications, vbvjbuffer Jullness =vbv_delay*target_bit_rate/90000. For VBR 
applications, the initial vbvjbuffer Jullness is often derived from the decoding time-stamp 
of the first picture, i.e. vbv_buffer Jullness = buffer bit level right before decoding of the 
25 first picture. For the elementary stream-only case, it is initially assumed that: 
vbvjbuffer Jullness = max( min( (2*bit_rate)/ framejrate, 
max_ybvjbuffer Jullness I 5 ) , Kl ) 

if the initial quantizer is non-linear and: 
vbvjbuffer Jullness = max( min( (4*bit__rate)/ frame jrate, 
30 max_vbv_buffer Jullness/ 2 ) , K2 ) 
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if the initial quantizer is linear , where Kl and K2 are constants. In one 
embodiment, the values for the constants may be Kl= 100000 and K2=200000. In an 
alternative embodiment of the invention, in a similar manner to the MPEG-2 test model 5 
(TM5) [3], three virtual buffers are used to measure the buffer fullness. 

5 

2. Initial Conditions in Picture Level 

The additional parameters required in the picture level are the quantization 
scale type : qscale_type and the average quantization level ovg_Qjprev jpict of the 
previous picture. 

10 Two variables need to be set for the rate-control in the picture level: (1) the 

initial virtual buffer fullness for the picture; (2) the bit budget for this picture. Also, the 
bits from picture header (and sequence header and GOP header for the beginning of the 
sequence or GOP) , header Jbits, are extracted. 

The virtual buffer fullness d is set to be the virtual buffer fullness of the 
15 current picture type, i.e. 

case IJTYPE : d = dOi; 
case P_TYPE : d = dOp; 
case B_TYPE : d = dOb. 

(2) The bit budget for this picture, denoted by target _pict_size, is allocated 
20 by a very simple transformation as follows: 

target _pict_size = input ^ictjsize* (target Jbitjr ate/input Jbit_r ate) 
For CBR applications, target bit rate/input Jbit_rate is pre-computed 
after parsing the sequence header. 

25 3. Update Variables in Picture Level 

Two variables are updated in the picture level: the virtual buffer fullness d. 
and the quantization type q_scale_type for this picture. 

( 1 ) d + = coded _pictsize - target j?ict_size , and 
case I_TYPE : d0i^d\ 

30 case PJTYPE : d0p=d\ 

case B JTYPE : d0b=d 

(2) The q_scalejtype for this picture is determined by the following rules : 
If this picture is the first picture or an I-picture, keep the q_scale_type to 

be the same as the corresponding input picture; 
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Otherwise, qjscalejype is set as follows : 

If ( avg_Qjprevjict<Tl \\ avgjQ_prev j>ict>T2 ) qjscalejype = / ; 
If ( avg_Q_prev_pict > T3 && avgjQ_prev _pict < T4) qjscalejype = 0; 
Where avg_Qj>revj>ict is the average mquant of the previous frame and 
5 TKT3<T4<T2. The typical values for 77, T2, T3, and T4 are: 
T1^15, T2=25, T3=18 and T4 =22. 
If qjcalejype is not set, the input qjscalejype is used. 
At the end of a picture, the video buffer verifier fullness 
vbvjbufferjullness is updated. The minimum picture size min jtictjsize is compared 
10 with the actual coded picture size coded j>ict_size for the frame just coded. If a deficit 
exists, ones are appended to the end of that frame. 

4. Initial Variables in Macroblock Level 

An initial quantization step-size (mquant) needs to be computed at the 
1 5 beginning of each picture. Such a quantization step-size is generated by an up-scaling 
conversion of the quantization step-size (input_mquant) of the corresponding input 
macroblock : 

mquant = input_mquant*(input_bit_rate/target_bit_rate); 

20 5. Updated Variables in Macroblock Level 

The macroblock (MB) quantization step-size, mquant, is updated by a use 
of a virtual buffer discrepancy. The virtual buffer discrepancy is calculated by the 
following formula : 

Virtual buffer discrepancy = d + the cumulated bits up to the current MB 
25 of a picture - the cumulated MB-bit-budget up to the current MB of a picture. 

The MB-bit-budget for each MB may also be computed by a down-scaling 

conversion: 

mb_bit_budget = input_mb_bitcount*(target__bit__rate/input_bit_rate). 
Although the invention has been described with reference to specific 
30 exemplary embodiments, it will be appreciated that it is intended to cover all 
modifications and equivalents within the scope of the appended claims. 
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WHAT IS CLAIMED IS: 



1 LA method of managing a video transmission bit-rate in a 

2 transcoder, comprising the steps of: 

3 measuring a fullness of an input buffer of the transcoder; 

4 providing a bit budget for one of plurality of frames in an input bitstream, 

5 the bit budget being based on a quantization parameter of said video frames; 

6 measuring an actual bit-rate of said input video stream; 

7 comparing said actual bit-rate with said buffer fullness to predict an input 

8 buffer underflow or overflow; and 

9 in response to an input buffer underflow, incrementing said bit budget for 

10 a next one of said plurality of video frames, and in response to an input buffer overflow, 

1 1 decrementing said bit budget for next one of said plurality of video frames. 

1 2. A method of controlling a bit-rate of a plurality of pictures in a 

2 video transcoder, where the transcoder includes a decoder and an encoder, the method 

3 comprising the steps of: 

4 determining a bit budget for a current picture at an input to the decoder; 

5 measuring a buffer fullness of an encoder buffer when the encoder buffer 

6 receives a previous picture; and 

7 allocating a number of bits to the current picture based on the buffer 

8 fullness, such that the allocated bits of the current picture is within the bit budget. 

1 3. The method according to claim 2, wherein the step of determining 

2 a bit budget further comprises the steps of: 

3 determining a size of available encoder buffer capacity after the encoder 

4 buffer receives a previous picture; and 

5 measuring a coded picture size of the current picture at the input to the 

6 decoder. 

1 4. The method according to claim 2, wherein the step of measuring a 

2 buffer fullness further comprises the step of determining the encoder buffer capacity. 

1 5. The method according to claim 2, wherein the step of allocating a 

2 number of bits to the current picture further comprises the step of adjusting a quantization 

3 of a decoded picture. 
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1 6. The method according to claim 2, wherein the step of allocating a 

2 number of bits to the current picture further comprises the steps of: 

3 setting a target bit size for the current picture; 

4 measuring an actual bit size for the current picture; and 

5 adjusting a quantization level for the current picture based on a differential 

6 between the target bit size and the actual bit size for the current picture, 

7 wherein the target bit size is calculated to be within a range of available 

8 encoder buffer bit space. 

1 7. A system for controlling a bit-rate of a plurality of pictures in a 

2 video transcoder, where the transcoder includes a decoder and an encoder, comprising: 

3 means for determining a bit budget for a current picture at an input to the 

4 decoder; 

5 means for measuring a buffer fullness of an encoder buffer when the 

6 encoder buffer receives a previous picture; and 

7 means for allocating a number of bits to the current picture based on the 

8 buffer fullness, such that the allocated bits of the current picture is within the bit budget. 

1 8. The system according to claim 7, further comprising: 

2 a video buffering verifier having configured to monitor the encoder buffer 

3 and measure the buffer fullness; and 

4 a controller, coupled with the video buffering verifier, and configured to 

5 receive bit-rate information from a transmission channel input to the decoder, wherein the 

6 bit-rate information is compared with the buffer fullness to allocate the number of bits to 

7 the current picture. 
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VIDEO RATE-BUFFER MANAGEMENT SCHEME FOR MPEG 

TRANSCODER 

CROSS-REFERENCES TO RELATED APPLICATIONS 
This application claims priority from Provisional U.S. Patent Application 
5 No. 60/1 1 8,965, filed February 4, 1999, the disclosure of which is incorporated herein in 
its entirety by reference for all purposes. 

BACKGROUND OF THE INVENTION 
The present invention relates generally to the encoding and decoding of 

1 0 multimedia data, and more particularly the invention relates to rate-buffer management in 
a transcoder of encoded, precompressed video data. 

A transcoder is a device that receives a bitstream that is pre-compressed and 
pre-encoded according to one of many digital transmission techniques, and outputs a 
compressed bitstream of a different transmission bit-rate. A simplified block diagram of a 

15 transcoder system 10 including a transcoder 12 is shown in Fig. 1 . The transcoder 12 

accepts a precompressed, encoded signal of video frames on an input from a transmission 
channel. The transmission channel may be a satellite transmission network, or cable 
transmission medium, for example. The input signal is decoded by a decoder 12 and re- 
encoded by an encoder 14, whereupon the re-encoded signal is output at a different, 

20 usually constant, bit-rate. Using well-known techniques of adjusting a quantization level 
of the re-encoded signal, careful management of encoder parameters can provide a high 
quality signal at a desired bit-rate that is tailored for a specific output transmission 
channel or application. 

An MPEG-2 video transcoder is a specific example of a transcoder that 

25 may employ techniques of the present invention. MPEG-2 is a conventionally accepted 
standard for digitally coding moving pictures, such as a video signal, for compressed 
transmission. The MPEG-2 video transcoder converts a pre-encoded and compressed 
video bitstream according to MPEG-2 video compression standards into another MPEG-2 
encoded, compressed video signal for transmission at a different bit-rate. 

30 An MPEG bitstream has six layers of syntax, at which certain coding 

parameters are specified. There are a sequence layer (random access unit, context), 
Group of Pictures (GOP) layer (random access unit, video coding), picture layer (primary 
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coding layer), slice layer (resynchronization unit), macroblock layer (motion 
compensation unit), and block layer (DCT unit). 

The term "signal" is applied herein to mean any picture, frame, or block. 
A block is an 8-row by 8-column matrix of pixels. A macroblock (MB) is four 8x8 
5 blocks of luminance data and 2, 4 or 8 corresponding 8x8 blocks of chrominance data 
derived from a 16x16 section of the luminance component of the picture. A slice refers to 
a series of macroblocks. Blocks of source data may be encoded by frame, macroblock, 
or slice. The first bit-rate may be for high-capacity satellite transmission of a coded 
source video, and the second bit-rate may be downscaled for lower-capacity local cable 

10 transmission, ultimately to a set-top box decoder to an individual viewer. A Group of 
Pictures (GOP) is a set of frames which starts with an I-frame and includes a certain 
number of P and B frames. The number of frames in a GOP may be fixed. Data rate for 
a given bitstream is directly related to buffer size and the speed with which bits are placed 
into and emptied from the buffer. 

15 Every transcoder employs some type of video rate-buffer management 

technique for preventing buffer under- and/or over-flows. In a decoder buffer under-flow 
situation, the decoder buffer is being emptied faster that it is being filled. Consequently, 
too may bits are being generated in the encoder, which will eventually overflow. To 
prevent decoder underflow, video rate-buffer management may provide for an increased 

20 quantization level, adjust the bit allocation, discard high frequency DCT coefficients, or 
repeat pictures. 

In a decoder buffer over-flow situation, the decoder buffer is being filled 
faster than it is being emptied. In other words, too many bits are being transmitted and 
too few bits are being removed by the decoder such that the buffer is full. Consequently, 

25 too few bits are being generated in the encoder, which will eventually underflow. Some 
video rate-buffer management techniques employed to avoid this situation include 
decreasing the quantization level, adjusting the bit allocation, and stuffing bits. 

Quantization level and bit allocation adjustments are conventionally 
accomplished by rate control algorithm along with an adaptive quantizer. A transcoder 

30 system 20 is illustrated in Fig. 2 with rate control 25 and adaptive quantization 23 

mechanisms. Generally, an encoded, compressed signal is first stored in a decoder buffer 
22, and then decoded at a decoder 24 in blocks or group of blocks. Rate control 25 is 
applied to control a data rate of bits being removed from the decoder buffer 22, based on 
a number and rate of bits being added to an encoder buffer 28. Adaptive quantization 

2 

JSDUCID <WO„ .0046997A1 IA> 



WO 00/46997 



PCT/US00/02967 



adjusts a quantization level of a bitstream as it is re-encoded by the encoder 26. Rate 
control and adaptive quantization are generally accomplished in three steps: 

1. Bit Allocation 

Most encoders have an optimized, and often complicated, bit-allocation 
5 algorithm to assign the number of bits for each type of pictures (I-, P-, and B-pictures). 
Conventional bit-allocation techniques take into account the prior knowledge of video 
characters (e.g. scene changes, fade, etc.) and coding types (e.g. picture types) for a group 
of pictures (GOP) by estimating a complexity and allocating target bits for a given GOP. 
Complexity Estimation: each picture type of I, P, and B pictures is 
10 assigned a relative weight X according to a global complexity measure of a Complexity 
Estimation technique. These weights (Xi, Xp, Xb) are reflected in a typical coded frame 
size of I, P, and B pictures. I pictures are assigned the largest weight since they have the 
greatest stability factor in an image sequence. B pictures are assigned the smallest weight 
since B data does not propagate into other frames through the prediction process. 
1 5 Picture Target Setting: allocates target bits for a frame based on the frame 

type (K P, and B) and the remaining number of frames of that same type in the GOP. 

2. Rate Control 

Rate control attempts to adjust bit allocation if there is significant 
difference between the target bits (anticipated bits) and actual encoded bits for a block of 
20 data. 

3. Adaptive Quantization 

Adaptive quantization is applied in the encoder along with rate-control to 
ensure the required video quality and to satisfy the buffer regulation. Adaptive 
quantization usually recomputes the macroblock quantization factor according to a 

25 comparison of the activity of a block against the normalized activity of the frame. The 

effect of this is to roughly assign a constant number of bits per macroblock, which results 
in a more perceptually uniform picture quality. 

As video distribution networks grow larger and more complex, transcoders 
using rate-control and adaptive quantization are required to be lower-cost, simple, and yet 

30 retain a good video quality. A video rate-buffer management scheme that includes a 

simplified rate-control and adaptive quantization algorithm is therefore highly desirable. 
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SUMMARY OF THE INVENTION 
The present invention provides a simplified rate control algorithm for a 
conventional video transcoder without requiring the GOP information. This may be 
accomplished by maintaining picture types, re-using motion vectors, and minimizing 
5 changes to the macroblock mode, and achieve the required video quality. 

According to one embodiment, the present invention provides a method of 
managing a video transmission bit-rate in a transcoder. The method includes the steps of 
measuring a fullness of an input buffer of the transcoder, providing a bit budget for one of 
plurality of frames in an input bitstream, the bit budget being based on a quantization 
10 parameter of said video frames, measuring an actual bit-rate of said input video stream, 
and comparing said actual bit-rate with said buffer fullness to predict an input buffer 
underflow or overflow. In response to an input buffer underflow, the bit budget is 
incremented for a next one of said plurality of video frames. In response to an input 
buffer overflow, the bit budget is decremented for next one of said plurality of video 
1 5 frames. 

According to another embodiment, the present invention provides a 
method of controlling a bit-rate of a plurality of pictures in a video transcoder, where the 
transcoder includes a decoder and an encoder. The method includes the steps of 
determining a bit budget for a current picture at an input to the decoder, measuring a 

20 buffer fullness of an encoder buffer when the encoder buffer receives a previous picture, 
and allocating a number of bits to the current picture based on the buffer fullness, such 
that the allocated bits of the current picture is within the bit budget. 

Other features and advantages of the present invention will be understood 
upon reading and understanding the detailed description of the preferred embodiments 

25 below, in conjunction with reference to the drawings, in which like numerals represent 
like elements. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 schematically illustrates a conventional video transcoder system. 
30 Fig. 2 schematically illustrates a conventional video transcoder system 

with adaptive quantizer and rate-control mechanisms. 

Fig. 3 schematically illustrates a video transcoder system including a video 
rate-management controller according to an embodiment of the present invention. 
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Fig. 4 illustrates a processor block of the video rate-management scheme 
according to an embodiment of the present invention. 

Fig. 5 illustrates a processor block of the video rat-management scheme 
according to an alternative embodiment of the present invention. 

5 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
The present invention provides a rate control process for efficient video 
rate-buffer management. According to a preferred exemplary embodiment of the 
invention, the rate control process is implemented in a video transcoder to control a 

10 transcoder output bitstream which complies with the requirements of the Video Buffering 
Verifier that are specified in the MPEG-2 video standard (ISO/IEC 13818-2). 

Fig. 3 illustrates a video transcoder 30 with a video rate-management 
system 32 according to an embodiment of the present invention. The video rate- 
management system operates according to a rate management process. The rate 

15 management system 32 includes a controller 34 operatively coupled to the transcoder, and 
providing instructions to a Video Buffering Verifier (VBV) 36. 

A Video Buffering Verifier (VBV) is a virtual decoder that is conceptually 
connected to the output of the encoder. Its purpose is to provide a constraint on the 
variability of the data rate that an encoder or editing process may produce (IS013818-2 

20 Annex C). The VBV contemplates a buffer in the receiver at the receiving end of the 
output transmission channel (not shown), and a prediction mechanism in the encoder. 
The prediction mechanism may a processor and control circuit that predicts a fullness of 
the buffer, i.e. buffer fullness, due to the constant fill from the constant bit-rate (CBR) 
stream and the variable empty from the variable bit-rate (VBR) due to the decoder bit 

25 demand. 

In an embodiment of the present invention, the controller 34 prevents 
encoder VBV 36 buffer under- and/or over-flows. The encoder VBV buffer may be a 
shifted "mirror" of a decoder VBV buffer, however for simplification only the encoder 
VBV will be discussed in detail. For Constant Bit-rate (CBR) applications, by a use of 
30 rate-control, a bit-count-per-second must precisely converge to the target bit-rate with 
good video quality. For Variable Bit-rate (VBR) applications, the rate-control achieves 
the goal of maximizing the perceived quality of decoded video sequence with the 
maintained output-bit-rate within permitted bounds. By employing a rate-management 
system of the present invention with rate control, transcoder buffer under- and over- flows 
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are avoided without adding too much complexity to the overall operation of the 
transcoder system. 

In accordance with the invention, for a number of pictures 1-j, the VBV 
buffer is characterized by the following parameters: 
5 vbvjbuffer Jiillness(j): the encoder VBV buffer bit-level right before 
encoding of the j-th picture. 

coded _pictj$ize(j)\ the bit-count of the j-th coded picture. 
bitsjncrement(j+l)\ the number of bits transmitted between the j-th and 
(j+1 )-th coded pictures. 
10 vbvjbuffer _size: the (decoder) VBV buffer size coded in the sequence 

header and sequence extension if present. 

These parameters satisfy the recursive equation: 

vbv^uffe^fullnessO+l) = vbv_buffer_fullness(j) + 
coded_pict_size(j) - bits_increment(j+l). (la) 
1 5 Assume the encoding time of j-th picture is t e j and decoding time of j-th 

picture is t dj . Then an upper bound on the VBV fullness is: 

vbv_buffer_fuliness(j) + coded_pict_size(j) < J R(i)dt 

t 

(lb) 

The VBV fullness upper bound is illustrated in Fig. 4, and 

20 \R(t)dt < vbv_buffer_fullness(j) + vbv_buffer_size, 

t 

(1c) 

Where R(t) is the bit-rate function. The left-side of Eq. (lc) is set to a maximum value as 

x max 

=(t dJ - tej) R max- 

25 (Id) 

Where t d j - t e j is the delay of the channel and R max .is the maximum channel bit-rate 
between t dJ - t e j. 

Therefore, a VBV fullness lower bound is: 
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vbv_buffer_fullness(j) > -vbv_buffer_size + Tmax. 

(le) 

The VBV fullness lower bound is illustrated in Fig. 5 
A video rate-buffer management process according to the invention can be 
5 accomplished with rate-control and adaptive quantization for efficient buffer-control. 

The rate-buffer management system and method according to an 
embodiment of the present invention checks a bitstream to verify that the amount of rate- 
buffer memory required in the decoder is bounded by the vbv_buffer_size. The rate- 
control process will be guided by the rate-buffer management protocol to ensure the 
10 bitstream satisfying the buffer regulation with good video quality. 

In one step of the rate-buffer management and rate-control process, a bit- 
budget is determined for each picture. In one embodiment of the invention, for the 
MPEG-2 transcoder for example, a bit-allocation process is followed for determining the 
bit-budget for each picture. According to the process, and for convenience of discussion, 
15 the following terms define the encoder VBV buffer-related variables: 

target Jbitjrate: the VBR or CBR bit rate from a storage media to the 

decoder; 

target _pict_size: the targeted bit-count of the current picture, often call the 
bit-budget for the picture. 
20 input Jbit_r ate: the bit rate of the input bitstream, 

input j?ict__size\ the bit-count of the current input (coded) picture (without 
picture header bits); 

coded j>ict_size\ the actual bit-count of the current coded picture (without 
picture header bits). 

25 framejrate: the frame rate of the video sequence given in the sequence 

header. 

max_vbv_buffer_fullness(j): assigned for the j-th picture or the j-th GOP. 
According to the invention, the bit-budget for the j-th picture is allocated 
by a down-scaling transformation as follows: 
30 target j>ict_size(j) = input _pict _size(j)* "(tar get _bit_r 'ate/input Jbitjrate). 

In an alternative embodiment, bit-allocation for the j-th picture 
accumulates the bit-budgets of all macroblocks (MBs): 
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target _pict_size(j) 

m unber of _ MBs—\ 

= 2^ round (input _mb _ size(i) * target __ bit _ rate I input _ bit rate + 0.5) 

where the round(*) function performs a rounding-toward zero and 
input _mb_size(i) denotes the bit-count of the i-th input MB. It should be understood that 
5 input _mb_size(I) *target_bit_r ate/input _bit_r ate is the target MB size. The bit-budget 
target _pict_size(j) for the j-th picture is checked against the vbvjbuffer Jullness(j) to 
prevent the VBV buffer under- and over-flows. The condition on the VBV buffer under- 
flow provides an upper limit on the bit-budget. The reason is that, at the time of 
decoding, the current picture should be small enough so that it is contained entirely inside 
1 0 the decoder buffer. 

It is known for transcoder that target _pict_size(j) needs to satisfy 
target _pict_size(j) < input _j>ictjsize(j). 

If the current picture size is too small, then Eq. (la) might exceed the 
max_vbv Jbuffer _fullness(j+ J } ) and then cause decoder buffer overflow. Thus a lower 
1 5 limit is placed on the current picture size. This may be achieved, for example, by limiting 
the bit budget, and if the actual bits used is still smaller than the minimum picture size, 
then the end of the picture may be stuffed with zero's. The lower limit is derived from 
Eqs.(la) and (le) as follows. 

target _j>ict_size(f) > vbv_buffer_size + T max - vbv_buffer_fullness(j-l) + T min . 
20 where Tmin^tej - tej.i) Rmin and R min . is the maximum channel bit-rate between tej - t e j_i. 
Note that R mitt = R max for the CBR channel. 

The inequality condition of (le) is verified for each slice or frame to 
prevent the encoder buffer under- flow. 

Down-scaling bit-allocation takes advantage of information provided by 
25 the input bitstream for CBR applications. For VBR applications, the down-scaling 

process requires an instantaneous bit-rate for each picture or every few pictures. This bit- 
rate, associated with max _vbv Jbuffer ^fullness, can be provided from StatMux. 

It is shown in the next section that the target picture size or the target MB 
size will effect the virtual buffer fullness and, as a consequence, it will generate the 
30 quantization scale for the corresponding MB. 

In general, the quantization scale (denoted by mquani) for the transcoded 
bitstream can also generated through a scaling process. Some commonly-used bit- 
allocation models are: 
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(1) T = -^ m MPEG-2 Test Model 5(TM5) [3]. 

k k 

(2) T = -± + -~ in MPEG-4 verification model [4]. 

Where T is the bit-budget for a picture or a slice or a MB, and k 0 are 
constants that are generated by a pre-estimation[4], and Q denotes the quantization scale 
corresponding to a picture or a slice or a MB, respectively. Since 
7 " rarge/ / T input - target _ bit _ rate I input _ bit rate , the quantization scale for the 

transcoded MBs thus can be estimated by: 

r? *u a 1 r ^ ^ zwpwr 6z7 rate 
For the model T = — , = 0. B , — - — = = , 

r\ ' >£-/arge/ *Z>input , . » 

y target _ bit _ rate 

k k 

For the model 7* = + , the quantization scale Q can be computed by 



target _ bit _ rate 

B — — — 

input _ bit _ rate 



* 0 W*o + 4 -*~^ 

r 



10 solving a quadratic equation : Q t!azet = - — where 



H K 



Qinput Qin 



\^ tinput >Cinput J 

Where Q input can be the average quantization level for this picture or slice 

at the input, or the quantization level of the MB at the input. The same process can also 
be applied to other bit-allocation models. 
15 Adjustment to the quantization scale may be accomplished according to 

the embodiment illustrated below. Let Q v denote the quantization scale determined by 
the virtual buffers fullness and Q target be the up-scaled quantization level given above. 

Assume that £?, argc , is the up-scaled quantization level for a given MB. 
Then, the quantization scale Q T for the MB is determined by 

c urren t c urren t 

20 If( X coded_mb_size> ^ target_mb_size) 

0 0 

Q T = max(&ar ge ,>&); 

else 

fir = mm(e flIIW ,a). 
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In an alternative embodiment, the quantization scale may be adjusted as 
follows. Assume that Q tvget is the up-scaled quantization level for a given picture or 

slice at the input and Q input is the average quantization level for this picture or slice at the 

input, respectively. Then, 

^ QtargetMB ~~ QinputMB ^~ CQinput ""2/argcf) * 

The quantization level Q T for the MB is determined by 

current c urren t 

If( X coded_mb_size> ^ target_mb_size) 

0 0 

Q T =max(e, argfiM , fl ,£ v ), 

else 

10 Qr = rmn(Q, aigaMB ,Q v ). 

The down-scaling process for bit-allocation is applied to the macroblock 
levels for their bit-budget estimation, and is described below with rate-buffer 
management and rate-control. According to an embodiment of the present invention, a 
15 rate management process includes five steps. In this embodiment, the down-scaling 
process for bit-allocation is only applied to the macroblock levels, which simplifies the 
bit- parser and counting process. For CBR applications, such a down-scaling process 
ensures that the VBV buffer never overflows for a "legal" input bitstream. 

20 1 . Initial conditions in Sequence Level 

The vbv buffer is initially filled the vbvjbuffer Jullness amount of bits. For 
CBR applications, vbvjbuffer Jullness =vbv_delay*target_bit_rate/90000. For VBR 
applications, the initial vbvjbuffer Jullness is often derived from the decoding time-stamp 
of the first picture, i.e. vbvjbuffer Jullness = buffer bit level right before decoding of the 
25 first picture. For the elementary stream-only case, it is initially assumed that: 
vbvjbuffer Jullness = max( min( (2*bit_rate)/ frame _r ate, 
max jvbv buffer Jullness! 5 ) , Kl ) 

if the initial quantizer is non-linear and: 

vbvjbuffer Jullness = max( min( (4*bit_rate)/ frame_rate, 
30 max_vbvjbuffer Jullness/ 2 ), K2) 
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if the initial quantizer is linear , where Kl and K2 are constants. In one 
embodiment, the values for the constants may be Kl =100000 and K2=200000. In an 
alternative embodiment of the invention, in a similar mariner to the MPEG-2 test model 5 
(TM5) [3], three virtual buffers are used to measure the buffer fullness. 

5 

2. Initial Conditions in Picture Level 

The additional parameters required in the picture level are the quantization 
scale type : qjscalejype and the average quantization level avg_Q_prev _pict of the 
previous picture. 

10 Two variables need to be set for the rate-control in the picture level: (1) the 

initial virtual buffer fullness for the picture; (2) the bit budget for this picture. Also, the 
bits from picture header (and sequence header and GOP header for the beginning of the 
sequence or GOP) , header _bits, are extracted. 

The virtual buffer fullness d is set to be the virtual buffer fullness of the 
15 current picture type, i.e. 

case I_TYPE : d = d0i\ 
case P_TYPE : d = dOp; 
case BTYPE : d = dOb. 

(2) The bit budget for this picture, denoted by target _pict_size, is allocated 
20 by a very simple transformation as follows; 

target jiictjsize = input jiict_size* (target _bit_r ate/input _bit_r ate) 
For CBR applications, target Jbit _r ate/input Jbit rate is pre-computed 
after parsing the sequence header. 

25 3. Update Variables in Picture Level 

Two variables are updated in the picture level: the virtual buffer fullness d, 
and the quantization type qjscalejype for this picture. 

( 1 ) d + = coded _pict_size - target _pict size , and 
case I_TYPE : d0i=d\ 

30 case P_TYPE : dOp=d; 

case B_TYPE : d0b=d 

(2) The qjscalejype for this picture is determined by the following rules : 
If this picture is the first picture or an I -picture, keep the qjscalejype to 

be the same as the corresponding input picture; 
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Otherwise, qscalejype is set as follows : 

If (avg_Q_prev j>ict<Tl \ \ avg_Qj?rev __pict>T2 ) q_scalejype = 1 ; 

If ( avg_Q_prev jpict > T3 && avgjQjtrev jyict < T4) qjscalejype = 0; 

Where avg_Qjprev _pict is the average mquant of the previous frame and 
5 TKT3<T4<T2. The typical values for T], T2, T3, and T4 are: 

77=75, T2=25> T3=18 and T4 =22. 

If qjscalejype is not set, the input q scalejype is used. 

At the end of a picture, the video buffer verifier fullness 
vbvjbuffer Jullness is updated. The minimum picture size min jtictjsize is compared 
10 with the actual coded picture size coded j)ict_size for the frame just coded. If a deficit 
exists, ones are appended to the end of that frame. 



4. Initial Variables in Macroblock Level 

An initial quantization step-size (mquant) needs to be computed at the 
15 beginning of each picture. Such a quantization step-size is generated by an up-scaling 
conversion of the quantization step-size (input_mquant) of the corresponding input 
macroblock : 

mquant = input_mquant*(input_bit_rate/target_bit_rate); 

20 5. Updated Variables in Macroblock Level 

The macroblock (MB) quantization step-size, mquant, is updated by a use 
of a virtual buffer discrepancy. The virtual buffer discrepancy is calculated by the 
following formula : 

Virtual buffer discrepancy = d + the cumulated bits up to the current MB 
25 of a picture - the cumulated MB-bit-budget up to the current MB of a picture. 

The MB-bit-budget for each MB may also be computed by a down-scaling 

conversion: 

mb_bit_budget = input_mb_bitcount*(target_bit_rate/input_bit_rate). 
Although the invention has been described with reference to specific 
30 exemplary embodiments, it will be appreciated that it is intended to cover all 
modifications and equivalents within the scope of the appended claims. 
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WHAT IS CLAIMED IS: 



1 LA method of managing a video transmission bit-rate in a 

2 transcoder, comprising the steps of: 

3 measuring a fullness of an input buffer of the transcoder; 

4 providing a bit budget for one of plurality of frames in an input bitstream, 

5 the bit budget being based on a quantization parameter of said video frames; 

6 measuring an actual bit-rate of said input video stream; 

7 comparing said actual bit-rate with said buffer fullness to predict an input 

8 buffer underflow or overflow; and 

9 in response to an input buffer underflow, incrementing said bit budget for 

10 a next one of said plurality of video frames, and in response to an input buffer overflow, 

1 1 decrementing said bit budget for next one of said plurality of video frames. 

1 2. A method of controlling a bit-rate of a plurality of pictures in a 

2 video transcoder, where the transcoder includes a decoder and an encoder, the method 

3 comprising the steps of: 

4 determining a bit budget for a current picture at an input to the decoder; 

5 measuring a buffer fullness of an encoder buffer when the encoder buffer 

6 receives a previous picture; and 

7 allocating a number of bits to the current picture based on the buffer 

8 fullness, such that the allocated bits of the current picture is within the bit budget. 

1 3. The method according to claim 2, wherein the step of determining 

2 a bit budget further comprises the steps of: 

3 determining a size of available encoder buffer capacity after the encoder 

4 buffer receives a previous picture; and 

5 measuring a coded picture size of the current picture at the input to the 

6 decoder. 

1 4. The method according to claim 2, wherein the step of measuring a 

2 buffer fullness further comprises the step of determining the encoder buffer capacity. 

1 5. The method according to claim 2, wherein the step of allocating a 

2 number of bits to the current picture further comprises the step of adjusting a quantization 

3 of a decoded picture. 
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1 6. The method according to claim 2, wherein the step of allocating a 

2 number of bits to the current picture further comprises the steps of: 

3 setting a target bit size for the current picture; 

4 measuring an actual bit size for the current picture; and 

5 adjusting a quantization level for the current picture based on a differential 

6 between the target bit size and the actual bit size for the current picture, 

7 wherein the target bit size is calculated to be within a range of available 

8 encoder buffer bit space. 

1 7. A system for controlling a bit-rate of a plurality of pictures in a 

2 video transcoder, where the transcoder includes a decoder and an encoder, comprising: 

3 means for determining a bit budget for a current picture at an input to the 

4 decoder; 

5 means for measuring a buffer fullness of an encoder buffer when the 

6 encoder buffer receives a previous picture; and 

7 means for allocating a number of bits to the current picture based on the 

8 buffer fullness, such that the allocated bits of the current picture is within the bit budget. 

1 8. The system according to claim 7, further comprising: 

2 a video buffering verifier having configured to monitor the encoder buffer 

3 and measure the buffer fullness; and 

4 a controller, coupled with the video buffering verifier, and configured to 

5 receive bit-rate information from a transmission channel input to the decoder, wherein the 

6 bit-rate information is compared with the buffer fullness to allocate the number of bits to 

7 the current picture. 
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Althouqh an event building system can in principal be described as a network of queues the details of the 
interconnecting network and the interdependence of the queues are difficult to express in mathematical probability 
functions. The approach of queueing theory is therefore not followed here and only one result from queueing theory 
will be reported: Little's law. This states [Kle75]: 

The average number of customers in a queueing system N is equal to the average arrival rate of customers to that 
system &lambda, times the average time spent in that system T: 

N - K-T 

This law which can be understood intuitively is a formal result of queueing theory and does not depend on any 
specific assumptions regarding the arrival time distribution, the service time distribution, the number of servers or 
the queueing discipline. For an event building system it relates the number of full events N Fvt to the latency L: 

(EQ5.1)< N Fvt> " < f > < L > 

where f is the input frequency (see section 3.1 .3). Little's law can also be applied for the event fragments: 

(EQ5^)< B >=< f > ( W 

Using the relation of latency and fragment latency (equation 3.3) and Little's law in the two forms one can derive a 
relation between buffer occupancy and latency: 

(EQ5.3){B)5{f)(L) 
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